Gradient-Based Learning Updates Improve XCS Performance in Multistep Problems
نویسندگان
چکیده
This paper introduces a gradient-based reward prediction update mechanism to the XCS classifier system as applied in neuralnetwork type learning and function approximation mechanisms. A strong relation of XCS to tabular reinforcement learning and more importantly to neural-based reinforcement learning techniques is drawn. The resulting gradient-based XCS system learns more stable and reliable in previously investigated hard multistep problems. While the investigations are limited to the binary XCS classifier system, the applied gradient-based update mechanism appears also suitable for the real-valued XCS and other learning classifier systems.
منابع مشابه
The Introduction of a Heuristic Mutation Operator to Strengthen the Discovery Component of XCS
The extended classifier systems (XCS) by producing a set of rules is (classifier) trying to solve learning problems as online. XCS is a rather complex combination of genetic algorithm and reinforcement learning that using genetic algorithm tries to discover the encouraging rules and value them by reinforcement learning. Among the important factors in the performance of XCS is the possibility to...
متن کاملThe Introduction of a Heuristic Mutation Operator to Strengthen the Discovery Component of XCS
The extended classifier systems (XCS) by producing a set of rules is (classifier) trying to solve learning problems as online. XCS is a rather complex combination of genetic algorithm and reinforcement learning that using genetic algorithm tries to discover the encouraging rules and value them by reinforcement learning. Among the important factors in the performance of XCS is the possibility to...
متن کاملModifying XCS for Size-Constrained Systems
Extended Classifier Systems, or XCS, is a soft-computing approach to machine learning in rule-based systems. While XCS has been shown effective in learning accurate, compact and complete mappings of an environment’s payoff landscape, it can require significant resources to do so. This paper presents four modifications that allow XCS to achieve high performance even in highly size-constrained po...
متن کاملCan Evolutionary Computation Handle Large Dataset?
Evolutionary Learning Classifier Systems (ELCS) were introduced by Holland a few decades ago. Since their birth, they were successfully applied to various data analysis domains. XCS is currently considered as state of the art ELCS. Earlier work have experimented with XCS on artificial problems or small datasets, and shown good results. However, XCS has not been tested on large datasets, particu...
متن کاملRobot reinforcement learning accuracy-based learning classifier systems with Fuzzy Policy Gradient descent(XCS-FPGRL)
This paper presented a novel approach XCS-FPGRL to research on robot reinforcement learning. XCS-FPGRL combines covering operator and genetic algorithm. The systems is responsible for adjusting precision and reducing search space according to some reward obtained from the environment, acts as an innovation discovery component which is responsible for discovering new better reinforcement learnin...
متن کامل